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(54) Network system and terminal apparatus 



(57) A moving image network system which has 
high response to a moving image transmission request 
and prevents interruption of a moving image signal. Up- 
on transmitting moving image data from terminal 1 to 
terminal 2, controller (20) adds a transmitter terminal ad- 
dress, priority and a coding type of the moving image 
data to transmission load information received by trans- 



mission load information receiver (17), and outputs the 
data to transmission load information transmitter (16). 
The controller (20) encodes/decodes moving image da- 
ta in accordance with transmission load information of 
the moving image data and adjusts transmission data 
amount corresponding to transmission load of a trans- 
mission path. 
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Description 



Present invention relates to an information network system and terminal apparatus and, more particularly, to an 
information network system connected to a plurality of terminals such as multimedia, a work station, a personal com- 
s puter and a printer. 

Conventionally, an information network system has been constructed as shown in Fig. 1 7. 

In Fig. 17, reference numeral 49 denotes a transmission path such is a coaxial cable. Numerals 50 to 54 denote 
terminals connected to the transmission path 49. Fig. 17 shows only the construction of the terminal 52, however, the 
other terminals have the same construction. 
10 in the terminal, numeral 61 denotes a data processor for generating transmission data and processing received 

data; 60, an output unit for transferring the transmission data generated by the data processor 61 to transmitter 56, 
which outputs the input data from the output unit 60 to the transmission path 49; 55, a receiver for receiving data from 
the transmission path 49; 59, an input unit for transferring the data received by the receiver 55 to the data processor 
61 ; 57, a collision detector for detecting a collision with another terminal and outputting a detection result to the data 
is processor 61 ; and 58, a carrier detector for detecting transmission from another terminal and outputting a detection 
result to the data processor 61 . 

In the conventional information network system having the above construction, a terminal which is going to perform 
data transmission confirms unused status of the transmission path 49 by the carrier detector 58, and transfers trans- 
mission data generated by the data processor 61 to the transmitter 56 via the output unit 60. The transmitter 56 converts 
20 the data into a predetermined signal and outputs the signal onto the transmission path 49. 

If the collision detector 57 detects a collision, the terminal transmits a predetermined jam signal from the transmitter 
56 and stands by in accordance with a predetermined back off algorithm, thereafter, retries transmission again. If no 
collision occurs, it transmits the transmission data. 

In the above conventional information network system, the receiver 55 of all the terminals always monitors data 
25 on the transmission path 49, and in a case where a reception address added to the data on the transmission path 49 
corresponds to the address of its own terminal, receives the data and transfers it to the input unit 59. 

However, the conventional system has following problems. 

In the conventional system, the right of use of the transmission path 49 is assigned to a terminal which has started 
transmission earlier than other terminals in a "first come, first served" manner regardless of priority or emergency. 
30 Accordingly, the other terminals have to wait for the termination of transmission of the terminal that has obtained the 
use of the transmission path 49. 

Further, in the conventional system, the transmission path 49 has not been efficiently used since data outputted 
onto the transmission path 49 is transmitted through the whole transmission path 49, and at this time, the transmission 
path 49 is used for only one transmission. For example, in Fig. 1 8, when the terminal 50 transmits data to the terminal 
35 52, the data from the terminal 50 is also transmitted to the terminals 54 and 56 which are not the receiver terminals of 
the transmission. In this case, as a result, the terminals 54 and 50 cannot perform transmission. 

As a moving image network system, an optical ring network having a structure as shown in Fig. 1 9 is considered. 
This network comprises video camera 65 as a moving image signal source, display 66 as a moving image output device 
and terminal 67 connected to the video camera 65 and the display 66. The terminal 67 has a function of encoding a 
moving image signal from the video camera 65 into a desired digital signal and outputting the signal to network interface 
68 and a function of decoding a digital signal from the network interface 68 and inputting the decoded signal into the. 
moving image output device. 

The network interface 68 has a function of examining slots of a frame which circulates on the optical ring network 
and inserting a digital signal outputted from the terminal into an empty channel and a function of reading out a digital 
45 signal from a channel for the terminal. Optical fiber 69 is employed as a transmission path for an optical signal trans- 
mitted on the optical ring network. 

However, the above optical ring network has a drawback that, as one channel is monopolistically assigned to the 
plural slots for one moving image signal transmission, a terminal which newly transmits a moving image transmission 
request when all the slots are used has to wait until one of the slots becomes empty, thus degrading response to 
so transmission request. 

To solve the above problem, sequentially changing the channel use in a predetermined time unit can be considered 
to realize transmission of moving image signals more than the number of the channels. In this case, however, the 
transmission of a moving image signal is halted at any time when the right of use of channel is lost. 

Further, in the above optical ring network, transmission capacity of one channel is fixed. For this reason, if a 
55 transmission moving image is a lower resolution image or a transmission data amount is small, a part of the transmission 
capacity is wasted, thus degrading the usage efficiency of the transmission path in the entire network. 

An aspect of the present invention provides a network system and terminal apparatus which has high usage effi- 
ciency of a transmission path. 
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Another aspect of the present invention provides a network system and terminal apparatus which transmits trans- 
mission data without delay- 
Further, another aspect of the present invention provides a terminal apparatus for a network system having high 
usage efficiency of a transmission path. 

According to one aspect of the present invention, provides an information network system comprising: a plurality 
of terminals; and a plurality of transmission media forming a transmission path by connecting the plurality of terminals, 
wherein the plurality of terminals respectively have: a memory for relaying transmission information; and transmission 
means for transmitting the transmission information in accordance with priority order, wherein said system transmits 
the transmission information on the transmission path formed by the transmission media in a predetermined direction. 

Another aspect of the present invention provides a network system and terminal apparatus for a moving image. 

A further aspect of the present invention provides a network system and terminal apparatus which has high re- 
sponse to moving image transmission request. 

Another aspect of the present invention provides a network system and terminal apparatus which traqsmits properly 
compressed moving image data corresponding to the status of a transmission path. 

According to another aspect of the present invention, provides a moving image network system, in which a plurality 
of terminals are connected to each other via a bi-directional transmission path, for inserting moving image data into a 
plurality of slots and transmitting/receiving the moving image data, comprising: means for generating transmission load 
information regarding transmission of the moving image data on the transmission path; means for transmitting/receiving 
the transmission load information in a direction opposite to a transmission direction of the moving image data; coding 
means for encoding the moving image data based on a predetermined coding method in accordance with the trans- 
mission load information; and decoding means for decoding the moving image data based on a predetermined decoding 
method. 

Another aspect of the present invention provides a network system and terminal apparatus having a novel structu re 
or function. 

A further aspect of the present invetion provides a network system and terminal apparatus for encoding a plurality 
of moving images by compression-rate variable coding and transmitting the coded images. 

Embodiments of the present invention will now be described with reference to the accompanying drawings, in 
which: 

Fig. 1 is a block diagram showing the configuration of a first embodiment of the present invention; 
Fig. 2 is a block diagram showing the construction of a terminal of the embodiment; 

Fig. 3 is a block diagram showing the construction of a terminal according to a second embodiment of the present 
invention; 

Fig. 4 is a block diagram showing the configuration of a moving image network system according to a third em- 
bodiment of the present invention; 

Fig. 5 is a block diagram showing the construction of encoder 1 22 of the moving image network system in the third 
embodiment; 

Fig. 6 is a block diagram showing the construction of decoder 1 21 of the moving image network system in the third 
embodiment; 

Fig. 7 illustrates an example of the structure of pixel units according to the third embodiment; 

Fig. 8 is a timing chart of sampling signals quadrupty interleaved at a period which is a quadruple of a pixel period 

of an input moving image signal to be used by A/D converters 125, 126, 127 and 128; 

Fig. 9 illustrates another example of pixel units divided from an moving image signal; 

Fig. 10 illustrates an example of eight slots divided from a video signal frame period by moving image data trans- 
mitter 119; 

Fig. 11 illustrates multiplexed moving image data and transmission load information transmitted in descending 
order by multiplexer 159; 

Fig. 1 2 is a block diagram showing the configuration of a moving image network system according to a modification 
to the third embodiment; 

Fig. 13 is a block diagram showing the configuration of a moving image network system according to a fourth 
embodiment of the present invention; 

Fig. 14 is a block diagram showing the construction of memory 1113 of the moving image network system in the 
fourth embodiment; 

Fig. 1 5 is a block diagram showing a modification to an encoder of the moving image network system in the fourth 
embodiment; 

Fig. 16 is a block diagram showing the construction of a decoder in the modification to the encoder in Fig. 15; 
Fig. 17 is a block diagram showing the configuration of the conventional information network system; 
Fig. 18 is a block diagram for explaining the problems of the conventional information network system; 
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Fig. 1 9 is a block diagram showing the configuration of the conventional moving image network as an optical ring 
network; and 

Fig. 20A to20C illustrate a transmission load information format. 
5 [First Embodiment] 

Fig. 1 is a block diagram showing the configuration of an information network system of the present embodiment. 
The network system comprises five terminals. 

In Fig. 1 , reference numerals 6 to 10 denote transmission paths comprising a coaxial cable or an optical fiber for 
10 connecting the terminals. It should be noted that the transmission path 49 in the conventional network is connected to 
all the terminals, while in this embodiment, the transmission paths 6 to 10 respectively connect adjoining two terminals. 

Numerals 1 to 5 denote terminals connected to each other by the transmission paths so as to form a ring shape. 
In this embodiment, data flows, e.g., from the terminal 1 to the terminal 2, from the terminal 2 to the terminal 3, .... from 
the terminal 5 to the terminal 1 . If the terminal 1 transmits data to the terminal 4, the terminal 1 transmits the data via 
'5 the terminals 2 and 3. 

As the respective terminals -have substantially the same construction, the construction of the terminal 1 will be 
described below with reference to Fig. 2. 

In Fig. 2, reference numeral 20 denotes a controller for controlling other devices via control bus 20a, storing re- 
ceived data into a predetermined internal memory in accordance with information including a reception address added 
20 to the head of the received data and priority information indicative of higher-priority or lower-priority (hereinafter these 
informations will be referred to as "header information"), and sequentially transmitting data stored in a plurality of 
memories in accordance with priority order. 

Numeral 1 1 denotes a receiver for receiving data from the transmission path 1 0. In a case where the transmission 
path comprises an optical fiber, the receiver 11 has a converter for converting an optical signal from the transmission 
25 path 10 into an electric signal. 

Numeral 12 denotes a selector for outputting the received data outputted from the receiver 11 to memories 13 or 

14 or input unit 1 9 under the control of the controller 20. 

From the received data, higher priority data for another terminal is stored into the memory 13, while lower priority 
data for another terminal is stored into the memory 14. These memories comprise a FIFO (first-in -first-out) memory. 
30 The input unit 19 transfers the received data inputted from the selector 12 to data processor 22 for generating data 
and processing received data. 

Numeral 21 denotes an output unit for outputting transmission data to which header information is added to the 
data generated by the data processor 22. The output unit 21 outputs the transmission data and transfers priority infor- 
mation of the data to the controller 20. 
35 Numeral 1 5 denotes a memory for storing higher priority data from the transmission data under the control of the 

controller 20. Numeral 1 6 denotes a memory for storing lower priority data from the transmission data under the control 
of the controller 20. Similarly to the memories 13 and 14, these memories comprise a FIFO memory. 

Numeral 18 denotes a selector for receiving data from any of the four memories 13 to 16 and outputting the input 
data to transmitter 17 under the control of the controller 20. 
40 The transmitter 1 7 transmits the data inputted from the selector 18 to the transmission path 6. In a case where the 

transmission path comprises an optical fiber, the transmitter 17 has a converter for converting an electric signal into 
an optical signal and transmitting the signal onto the transmission path 6. 

Next, the operation of the present embodiment will be described in detail below. 

in Fig. 1, when the terminal 1 receives data transmitted from the terminal 5, the controller 20 in the terminal 1 
45 examines the header information of the received data. 

If the reception address of the received data corresponds to the address of the terminal 1 , the controller 20 sets 
an output destination of the selector 12 to the input unit 19 and transfers the received data to the data processor 22 
via the input unit 19. On the other hand, if the reception address of the received data does not correspond to the 
address of the terminal 1 , the controller 20 writes the received data into the memory 1 3 or the memory 1 4 in accordance 
50 with the priority information of the data. 

Upon transmission, the data processor 22 generates transmission data, adds header information to the transmis- 
sion data, and outputs the data to the output unit 21 . The output unit 21 writes the transmission data into the memory 

15 or the memory 16 in accordance with the priority information of the data. 

The controller 20 examines presence/absence of data stored in the memories 1 3 to 16. If data exists in any of the 
55 memories, the controller 20 transmits the data by the transmitter 17 in a predetermined order, e.g., the memory 13, 
the memory 14, the memory 15 and the memory 16. 

More specifically, if data exists in the memory 13, the controller 20 controls the selector 18 to read the data out of 
the memory 13 and input the data into the transmitter 17. 
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If data exists in the memory 14, the controller 20 controls the selector 18 to read the data out of the memory 14 
and input the data into the transmitter 17. 

If received data is newly written into the memory 1 3 during transmission of the data stored in the memory 1 4 (when 
data having priority higher than that of data currently being transmitted is received), the controller 20 transmits the data 
5 stored in the memory 13 immediately after the transmission of the current transmission. That is, the controller 20 
performs the transmission of the data in the memory 1 3 prior to transmission of data stored in the memories 15 and 16. 

If the transmission of the data stored in the memory 1 4 is over and there is no data in the memory 1 3, the controller 
20 transmits data stored in the memory 15. Further, if the transmission of the data in the memory 15 is over and there 
is no data in the memory 1 3 or the memory 14, the controller 20 transmits data stored in the memory 16. 
10 in the present embodiment, if transmission of data stored in the memories 13 to 16 is over and the memories 

become empty, the terminal comes into transmission waiting status. 

In the above description and figures, the information network system comprises five terminals, however, the present 
embodiment is not limited to this number of terminals. The network system can comprise an arbitrary number of ter- 
minals. 

15 In the above description, the memories 13 to 16 are FIFO's, however, the present embodiment is not limited to 

this arrangement. For example, the system can employ normal memories with a data management table managed by 
the controller 20. In the data management table, a series of reception data numbers indicative of data reception order, 
address information indicative of a memory in which data corresponding to the number is stored, a series of transmission 
data numbers indicative of data transmission order, and address information indicative of a memory in which trans- 
it? mission data corresponding to the number is stored are recorded. The controller 20 deletes a data number and address 
information in accordance with completion of data transmission. 

As described above, according to the present embodiment, connecting terminals with transmission paths to trans- 
mit data with header information such as information indicative of a reception address and priority in one direction 
realizes an information network system having high usage efficiency of transmission paths, all of which are not occupied 
25 with only one transmission. Further, according to the embodiment, a plurality of data transmitted onto the transmission 
paths are arranged in priority order at a terminal previous to the destination terminals and relayed to their respective 
destinations. Each destination terminal receives corresponding data, as a result, the data amount on the transmission 
path is reduced, thus quickly transmitting higher-priority data. 

30 [Second Embodiment] 

Next, an information network system according to the second embodiment of the present invention will be described 
in detail with reference to Fig. 3. In Fig. 3, components corresponding to those in the first embodiment have the same 
reference numerals, and the explanations of these components will be omitted. 
35 The second embodiment describes an information network system comprising five terminals 1 to 5, connected to 

each other in the same manner as the first embodiment, for dealing with moving image data and code data. In this 
embodiment, the priority of moving image data is higher and that of code data is lower. The moving image data priority 
is set to "1 ", and the code data priority is set to "2". 

Fig. 3 is a block diagram showing the construction of the terminal 1 of the present embodiment. 
40 in Fig. 3, received data enters the selector 1 2. If the received data is moving image data for another terminal, the 

selector 12 outputs the data to the memory 1 3; if the data is code data for another terminal, the selector 12 outputs 
the data to the memory 1 4; if the received data is moving image data for the terminal 1, the selector 12 outputs the 
data to decoder 45; if the received data is code data for the terminal 1 , the selector 12 outputs the data to the input 
unit 19. The selector 12 outputs the received data under the control of the controller 20. 
45 The decoder 45 removes header information of the received data and decodes the received data to convert it into 

a predetermined video signal. 

Numeral 46 denotes a display for displaying an image represented by the video signal inputted from the decoder 
45; 48, a video input unit in which a video signal is inputted from, e.g., a video camera and VTR (video tape recorder); 
47, an encoder for encoding the video signal inputted from the video input unit 48 in frame units : adding header infor- 
50 mation to the coded data to convert the data into transmission moving image data. 

In the present embodiment, the moving image data outputted from the encoder 47 is stored into the memory 15. 
Code data which has been generated by the data processor 22 is stored via the output unit 21 into the memory 16. 

Next, the operation of the present embodiment will be described in detail below. 

When the terminal 1 receives data transmitted from the terminal 5, similarly to the previous: embodiment, the 
55 controller 20 of the terminal 1 examines the header information of the received data. 

If the reception address of the received data coincides with the address of the terminal 1 and the priority information 
of the received data is "1 the controller 20 sets the output destination of the received data to the decoder 45 ; if the 
priority information is "2", the controller 20 sets the output destination to the input unit 19. On the other hand, if the 
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reception address of the received data does not coincides with the address of the terminal 1 and the priority information 
is "T, the controller 20 sets the output destination to the memory 13; if the priority information is "2", sets the output 
destination to the memory 14. 

The controller 20 examines presence/absence of data stored in the memories 13 to 16. If data exists in any of 
5 these memories, the controller 20 transmits the data by the transmitter 17 in accordance with a predetermined order, 
e.g., the memory 13, the memory 14, the memory 15 and the memory 16. 

The controller 20 performs transmission of moving image data stored in the memory 1 3 or the memory 15 in frame 
units. Note that as reading bit rate in the memory 15 is much higher than encoding bit rate in the encoder 47, data 
time-axis compression is made, and transmission can be performed such that a frame of another moving image or 
io code data is inserted between frames of the transmission moving image. 

In the present embodiment, image data is not limited to moving image data, still-image data can also be treated. 

As described above, the present embodiment has an advantage substantiallysimilar to that of the first embodiment. 
Further, in this embodiment, the transmission paths can be used more efficiently, for moving image data of large data 
amount is transmitted in preference to other data of smaller data amount, in addition, another moving image frame or 
'5 code data can be inserted between the transmission moving image data frames. 

As described above, the first and second embodiments provide an information network system for transmitting 
information in a predetermined direction on a transmission path formed by connecting a plurality of terminals with a 
plurality of transmission media, and a terminal apparatus which stores at least one part of received information and 
transmission information formed by the apparatus in accordance with information type, and transmits the stored infor- 
20 mation in accordance with priority order. 

[Third Embodiment] 

Fig. 4 is a block diagram showing the configuration of a moving image network system according to the third 
2S embodiment of the present invention. In Fig. 4, the moving image network system comprises five terminals 101 to 105. 
As these terminals have the same construction, Fig. 4 shows only the construction of the terminal 101 . 

Numerals 106 to 115 denote transmission paths comprising a coaxial cable for connecting the terminals. Among 
these transmission paths, the transmission paths 111 to 115 are employed for transmitting moving image data, and 
the transmission paths 106 to 110 are employed for transmitting data other than moving image data. 
30 Numeral 1 1 6 denotes a transmission load information transmitter for transmitting information of transmission load, 

which is for transmitting moving image data from the terminal 101 to the terminal 102, to the terminal 105. The descrip- 
tion of the transmission load information will be given later. Numeral 117 denotes a transmission load information 
receiver for receiving transmission load information transmitted from the terminal 102. Numeral 118 denotes a moving 
image data receiver for receiving moving image data transmitted via the transmission path 115. 
35 Numeral 119 denotes a moving image data transmitter. As shown in Fig. 10, the moving image data transmitter 

1 1 9 divides a video signal frame period into eight slots, inserts moving image data, to which header information to be 
described later is added, into the respective slots, and transmits the signal onto the transmission path 111. Numeral 

1 20 denotes a controller which examines the header information of the moving image data outputted from the moving 
image data receiver 118 including informations such as an address indicative of a terminal to receive the moving image 

to data, priority and coding type, and if the receiving terminal address corresponds to the address of the terminal 101, 
the controller 120 controls the decoder 1 21 to receive the moving image data from the moving image data receiver 118. 

On the other hand, if the receiver terminal address does not coincide with the address of the terminal 101 , the 
controller 120 compares the priority of the received moving image data with that of a moving image signal outputted 
from the encoder 122, and outputs a higher priority signal to the moving image data transmitter 119. Further, the 
45 controller 1 20 controls the amount of moving image data generated by the encoder 1 22 in accordance with information 
from the transmission load information receiver 117. 

That is, if the controller 120 receives data indicative of targe transmission load from the transmission load infor- 
mation receiver 117, the controller 120 changes the operation of the encoder 122 so as to reduce the moving image 
data amount. More specifically, the compression-rate of the encoder 122 is improved, otherwise, a part of the data 
50 outputted from the encoder 122 is deleted. 

Furthermore, the controller 1 20 adds the transmission load information including a transmitter terminal address of 
the moving image data transmitted from the terminal 101 to the terminal 102, the priority of the data and a coding type, 
to the transmission load information received by the transmission load information receiver 117, and outputs the data 
to the transmission load information transmitter 116. As the terminals 101 to 105 respectively perform this addition, 
55 the transmission load information includes transmitter terminal addresses, priorities and coding types regarding all the 
moving image data transmitted between the terminals. 

The transmission load information is transmitted in a direction opposite to a moving image data transmission di- 
rection. Each transmitter terminal can grasp in advance the transmission load of the terminal between the transmitter 
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and receiver terminals that relays the moving image data to the receiver terminal by examining the transmission load 
information. 

Fig. 20A to 20C illustrate the transmission load information format in the present embodiment. As described above, 
the transmission direction of the transmission load information is opposite to that of moving image data. In Fig. 4, the 
5 transmission load information is transmitted via the transmission path 106 to 110. 

Fig. 20A shows frames for the terminals 101 to 105, and the frames have the same construction. The respective 
terminals write information into a corresponding frame. Each terminal frame have, as Fig. 20B, slot frames 1 to 8 
corresponding to the eight slots for the moving image data transmitted via the transmission path 111 to 115 in Fig. 4. 
Each slot frame includes, as Fig. 20C, information of a corresponding slot: "whether the slot is empty or not"; "transmitter 
10 terminal address"; "priority"; and "coding type". 

In Fig. 4, numeral 121 denotes a decoder for decoding moving image data transmitted to the terminal 101 and 
outputting the data as a predetermined analog video signal. Fig. 6 shows the construction of the decoder 121 . 

Numeral 123 denotes a display which functions as a moving image output device, for displaying a moving image 
by the analog video signal outputted from the decoder 121. Numeral 1 22 denotes an encoder for converting an analog 
is video signal outputted from video camera 124 as a moving image information source into four partial moving image 
data as moving image data in accordance with predetermined conversion method to be described later, adding a 
predetermined header to the respective data, and outputting the data to the moving image data transmitter 119 under 
the control of the controller 120. 

Fig. 5 is a block diagram showing in detail an example of the construction of the encoder 122. The encoder 122 
20 may be any encoder so far as it employs variable compression rate coding, e.g., MPEG 1 , MPEG 2 and H.261 . In Fig. 
5, numeral 129 denotes a system clock generator for extracting a synchronous signal from the moving image signal 
outputted from the video camera 124 and generating sampling signals and various timing signals used within the 
terminal. Numerals 125 to 128 denote A/D converters for A/D conversion of an input moving image signal based on 
the sampling signals from the system clock generator 129. 
25 Numeral 1 30 denotes a connector for inputting the outputs from the A/D converters 1 25 to 1 28 into encoding units 

131 to 134. The encoding units 131 to 134 encode the outputs from the A/D converters 125 to 128 into four partial 
moving image data based on predetermined conversion method to be described later. 

Numerals 136 to 139 denote dual port memories for respectively storing outputs from the encoding units 131 to 
134 in accordance with a writing address outputted from writing counter 135. The writing counter 1 35 outputs a writing 
30 address to the dual port memories 1 36 to 1 39 in accordance with the sampling clock outputted from the system clock 
generator 129. 

Numeral 140 denotes a read-out counter for outputting a read-out address to the dual port memories 1 36 to 1 39 
in accordance with a transmission timing signal outputted from the system clock generator 1 29. Numeral 141 denotes 
a header adder for adding header information including a receiver terminal address, a transmitter terminal address, 
35 priority and the tike to the partial moving image signals read out of the dual port memories 1 36 to 1 39. 

Fig. 6 is a block diagram showing in datail an example of the construction of the decoder 121 . In Fig. 6, numeral 
1 42 denotes a header remover for removing header information added to a partial moving image signal. Numerals 1 43 
to 146 denote dual port memories for reproducing a plurality of partial moving image signals whose headers have been 
removed. Writing counter 147 generates a writing address for respectively writing the header-removed partial moving 
40 image signals into a predetermined area of the dual port memories 143 to 146. 

Numeral 149 denotes a read-out counter for generating a read-out address for respectively reading the partial 
moving image signals out of the dual port memories 143 to 146 based on a timing signal outputted from system clock 
generator 154. Numeral 148 denotes a connector for inputting the outputs from the dual port memories 143 to 146 into 
decoding units 150 to 153 for decoding the coded partial moving image signals based on decoding method to be 
45 described later. 

Numeral 1 55 denotes a synthesizer for synthesizing the multiple-interleaved moving image signals outputted from 
the decoding units 150 to 153 into one moving image signal. Numeral 156 denotes a D/A converter for converting the 
output from the synthesizer 155 into a desired analog video signal and outputting the signal to the display. 

In the present embodiment, as shown in Fig. 7, a moving image signal is divided into four pixels °a, b, c and d" 
50 aligned in a main-scanning direction, the four-pixel unit is divided into partial moving images based on the following 
coding conversion method. 

Here, a pixel unit having N 0 pixels is P 0 , and an average value of the pixels is m 01 . The pixel unit P 0 is divided into 
two groups P 1 and and average values of pixels of the groups P n and Q 1 are respectively vn n and n 1v 

Further, the pixel group P 1 is divided into two pixel groups P 21 and Q 21 , and the pixel group Q,, is divided into two 
55 pixel groups P 22 and Q 22 - Average values of pixels of the groups P 21 and Q 21 are respectively m 21 and n 21 , and average 
values of pixels of the groups P 22 and Q 22 are respectively m 22 and n 22 . 

In this manner, division of pixel unit is continued till the number of pixels belonging to the pixel groups P and Q 
becomes one and an average value of pixels of each group is obtained, so that a partial moving image signal k is 
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calculated from the N 0 average values m of and the N 0 - 1 average value n of: 



k oi - m 01 



'01 



w k 2i = m 2i " m n 



k 22 _ m 22 - n n 



15 

k 31 = m 31 - m 21 



20 



k 32 - m 32 - n 21 



k 33 ~ m 33 " m 22 



25 k 34 " m 34 ' n 22 



35 The coding conversion equations are: 

(Encoding unit 1 31 ) k 01 = 1/4 (a + b + c + d) (1 ) 

40 

(Encoding unit 132) k n = 1/2 (a + b) - 1/4 (a + b + c + d) (2) 

(Encoding unit 133) k 21 = a - 1/2 (a + b) (3) 

45 

(Encoding unit 134) k 22 = c - 1/2 (c + d) (4) 
^ The decoding conversion equations are: 

(Decoding unit 150) a = k 01 + k n + k 21 (5) 

5 5 (Decoding unit 151) b = k 01 + k n - k 21 (6) 
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(Decoding unit 152) 




22 



(7) 



5 



(Decoding unit 153) 



d - k oi " k i 1 " k : 



'22 



(8) 



It should be noted that the above coding scheme has been disclosed in the prior application U.S. S.N. 07/924,629 
by the present applicant. 

Next, the operation of the moving image network system according to the third embodiment will be described below. 
In this system, each terminal performs necessary one of the following three operations; 

(1) coding: dividing a transmission moving image signal into a predetermined number of partial moving image 
signals in accordance with the number of empty slots with reference to transmission load information and encoding 
the partial moving image signals. 

(2) transmission: transmitting partial moving image data signal received from a transmission path and moving 
image data generated by the terminal itself onto the transmission path in accordance with a predetermined pro- 
cedure with reference to transmission load information, and transmitting information regarding the moving image 
data currently being transmitted by the terminal itself in a direction opposite to a transmission direction of the 
moving image data. 

(3) decoding: decoding received to the terminal itself partial moving image signals. 
These operations will be described in detail below. 

<Coding Operation> 



If the controller 20 confirms with reference to trasmission load information that there are more than four empty 
slots in each transmission of a corresponding terminal to relay the transmission between the transmitter terminal and 
the receiver terminal, it instructs the encoder 122 to perform coding using four slots. Thereafter, when a moving image 
signal enters the encoder 122 from the video camera 124, the system clock generator 129 separates horizontal and 
vertical synchronous signals from the moving image signal. 

Fig. 8 shows sampling signals ^ to 0 4 for the A/D converters 125 to 128 quadruply interleaved at period 4T which 
is a quadruple of pixel period of an input moving image signal. The input moving image is sampled with the pixel unit 
"a, b, c and d" in Fig. 7 and A/D-converted by the A/D converters 125 to 128. Clock t(> 0 latches the A/D converters 125 
to 128 so that the converters simultaneously output converted data, and the outputs of the A/D converters enter the 
encoding units 131 to 134 via the connector 130. 

The encoding unit 131 obtains an average value of the outputs from the A/D converters 125 to 128, which are 
image signals in the a, b, c and d pixel units, by the 4T periods based on the equation (1) and outputs the obtained 
average value to the dual port memory 136. 

The encoding unit 1 32 obtains a difference value between an average value of the outputs from the A/D converters 
125 and 126 and an average value of the outputs from the A/D converters 125 to 128 by the 4T periods based on the 
equation (2). The encoding unit 1 32 outputs the obtained difference value to the dual port memory 137. 

The encoding unit 1 33 obtains a difference value between the output from the A/D converter 1 25 and the average 
value of the outputs from the A/D converters 125 and 126 by the 4T periods based on the equation (3), and outputs 
the obtained difference value to the dual port memory 138. 

The encoding unit 1 34 obtains a difference value between the output from the A/D converter 1 27 and the average 
value of the outputs from the A/D converters 127 and 128 by the 4T periods based on the equation (4), and outputs 
the obtained difference value to the dual port memory 1 39. 

The partial moving image signals k 01 , k u , k 21 and k 22 as the outputs from the encoding units 1 31 to 1 34 are inputted 
into the dual port memories 136 to 139 by the 4T periods and respectively stored into a predetermined position in 
accordance with a writing address outputted from the writing counter 135. 

On the other hand, the read-out counter 1 40 generates a read -out address at a predetermined transmission timing 
and sequentially outputs the address to the dual port memories 1 36 to 1 39 by the instruction of the controller 1 20. The 
reading is first directed to the dual port memory 136. From the dual port memory 136, a partial moving image signal 
is sequentially read out as a serial signal in accordance with the read-out address and outputted to the header adder 



The header adder 141 adds header information including a receiver terminal address, the address of its own 
terminal as a transmitter terminal (e.g. , the terminal 1 ) ; coding type "A", and priority " 1 " to the output from the dual port 



25 



55 



141. 
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memory 136 and outputs the data to the moving image data transmitter 119. Similarly, the header adder 141 adds 
header information including the same receiver and transmitter terminal addresses, coding type fl B" and priority "2" to 
the output from the dual port memory 137 and outputs the data to the moving image data transmitter 119. 

The header adder 1 41 adds header information including the same terminal addresses, coding type "C" and priority 
s "3" to the output from the dual port memory 138 and outputs the data to the moving image data transmitter 119. The 
header adder 141 adds header information including the same terminal addresses, coding type "D" and priority "4" to 
the output from the dual port memory 1 39 and outputs the data to the moving image data transmitter 119. 

If the number of slots designated by the controller 120 is three, the encoding unit 134 becomes inactive and the 
outputs from the dual port memories 1 36, 1 37 and 1 38 are transferred to the moving image data transmitter 1 1 9; if the 
10 number of slots is two, the encoding units 1 33 and 1 34 become inactive and the outputs from the dual port memories 
1 36 and 1 37 are transferred to the moving image data transmitter 119; if the number of slots is one, the encoding units 
1 32, 1 33 and 1 34 become inactive and the output from the dual port memory 1 36 is transferred to the moving image 
data transmitter 119. 

'5 transmission Operation> 

In one terminal, when there is no transmission moving image data, the controller 1 20 examines header information 
added to the head of moving image data outputted from the moving image data receiver 118 shown in Fig. 4. If the 
receiver terminal address in the header information coincides with the address of the terminal, the controller 1 20 trans- 

20 fers the outputs from the moving image data receiver 118 to the decoder 1 21 . However, if the receiver terminal address 
does not coincide with the address of the terminal, the controller 120 transfers the output from the moving image data 
receiver 118 to the moving image data transmitter 119, inserts the data into a predetermined empty slot and transmits 
the data by the moving image data transmitter 11 9. 

Every time a slot which contains moving image data is transmitted, the controller 120 temporarily records the 

25 transmitter terminal address of the moving image data, the coding type and the priority of the data in an internal memory 
(not shown) of the terminal as transmission load information of its own terminal. If there is no transmission moving 
image data and empty slots are transmitted, the controller 120 makes a record of the transmission of empty slots. 

When the transmission load information receiver 117 newly receives transmission load information, the controller 
120 reads out the transmission load information of its own terminal recorded in the above manner, and updates the 

30 transmission load information of its own terminal received from the transmission load information receiver 117. More 
specifically, the controller 1 20 changes the transmission load information to information regarding moving images trans- 
mitted within a predetermined video frame period before current time, i.e., information regarding moving image data 
transmitted using the eight slots. If empty slots have been transmitted, the controller 120 changes the transmission 
load information into information indicative of the transmission of empty slots. Then, the controller 120 transmits the 

35 updated information from the transmission load information transmitter 116. As described above, Fig. 20 shows the 
frame format of the transmission load information. 

When a terminal transmits moving image data generated in the terminal, the controller 120 of the transmitter 
terminal examines transmission load information outputted from the transmission load information receiver 1 1 7. If trans- 
mission load information of all the terminals between the transmitter terminal and the receiver terminal indicates that 

40 there are more than four empty slots, the transmission can be made using four slots. The controller 120 instructs the 
encoder 1 22 to perform coding using four slots. Similarly, if the number of empty slots is any of three, two.and one the 
controller 120 instructs the encoder 122 to perform coding using any of three, two and one slot, thus raising a com- 
pression rate. 

If the number of empty slots is zero, the controller 1 20 examines the transmission load information and determines 
4 $ whether or not there is one or more slots having priority "2" or lower in any of the terminals between the transmitter 
and receiver terminals. If one slot exists, the controller 1 20 instructs the encoder 1 22 to perform coding using one slot. 
If no slot exists, the transmission is postponed until such slot appears or an available empty slot appears. 

When coding instruction is inputted from the controller 120, the encoder 122 performs coding based on the in- 
struction and outputs coded moving image data to the moving image data transmitter 119. If there is an empty slot, 
so the moving image transmitter 119 inserts the moving image data outputted from the encoder 122 into the slot and 
performs transmission. If there is no empty slot, the moving image data transmitter 119 deletes moving image data of 
priority "2" or lower outputted from the moving image data receiver 118, inserts the moving image data outputted from 
the encoder 122 into a slot assigned to the deleted data, and performs transmission. 

As transmission load information received to the respective terminals in the above manner, the terminal which has 
55 transmitted the deleted data finds the deletion of its transmission data by detecting that the description about the 
transmission moving image data does not exist in the information of the terminals between the transmitter terminal and 
the receiver terminal. The transmitter terminal of the deleted data stops an encoder corresponding to the deleted data. 

It should be noted that the deletion may not directed to the whole image data. For example, higher-resolution data 
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out of hierarchically-encoded data may be deleted and lower-resolution data may be kept. 

In this manner, each transmitter terminal always examines transmission load information after starting of trans- 
mission, and when the moving image data transmitted from the transmitter terminal itself is deleted, it stops an encoder 
corresponding to the deleted moving image data. If any empty slot appears when the transmitter terminal has encoder 
s currently being stopped, it activates the encoder from the highest priority, thus lowering compression rate to transmit 
more moving image data. 

<Decoding Operation> 

J0 The header remover 142 in Fig. 6 removes header from partial moving image data inputted to the decoder 1 21 . If 

coding type recorded in the header is "A", the header remover 142 writes the data into the dual port memory 143 for 
coding type "A" in accordance with a writing address outputted from the writing counter 147. If the coding type is any 
of "B", "C" and "D", the header remover 142 writes the data into corresponding one of the dual port memory 144 for 
coding type H B", the dual port memory 145 for coding type "C", and the dual port memory 146 for coding type "D" in 

15 accordance with the writing address from the writing counter 1 47. 

The number of partial moving image data transmitted from a transmitter terminal is controlled by the transmission 
load information of the terminals between the transmitter and receiver terminals. The receiver terminal changes oper- 
ation of the decoder 121 based on the number of received partial moving image signals. 

The controller 120 counts the number of partial moving image data signals arrived at the decoder 121 at frame 

20 period of an image to be outputted to the display 1 23. If the number is four, it controls the read-out counter so that the 
data stored in the dual port memories 143 to 146 can be read out. The system clock generator 154 outputs system 
signals <|t 1 to § 4 quadruply interleaved by the 4T periods. 

The read-out counter 149 counts the system signals outputted from the system clock generator 154 and outputs 
read-out addresses to the dual port memories 143 to 146 by the 4T periods to perform reading out of the stored data. 

25 The outputs from the dual port memories 1 43 to 1 46 enter the decoding units 1 50 to 1 53 via the connector 1 48. 

The decoding unit 150 decodes the moving image signal corresponding to "a" of the "a, b, c and d" pixel unit in 
Fig. 7 by the 4T periods by adding the output signals from the dual port memories 143 to 145 based on the equation 
(5). The decoding unit 1 50 outputs the decoded signal to the synthesizer 1 55 at the timing of the system signal tj^ . The 
decoding unit 151 decodes the moving image signal corresponding to "b" of the pixel unit by the 4T periods by sub- 

30 trading the output from the dual port memory 145 from the sum of the outputs from the dual port memories 143 and 
144 based on the equation (6). The decoding unit 151 outputs the decoded signal to the synthesizer 155 at the timing 
of the system signal <J> 2 . 

The decoding unit 152 decodes the moving image signal corresponding to "c" of the pixel unit by the 4T periods 
by subtracting the output from the dual port memory 1 44 from the sum of the outputs from the dual port memories 1 43 

35 and 146 based on the equation (7). The decoding unit 152 outputs the decoded signal to the synthesizer 155 at the 
timing of the system signal <J> 3 . The decoding unit 153 decodes the moving image signal corresponding to "d" of the 
pixel unit by the 4T periods by subtracting the outputs from the dual port memories 144 and 146 from the output from 
the dual port memory 1 43 based on the equation (8). The decoding unit 1 53 outputs the decoded signal to the synthe- 
sizer 155 at the timing of the system signal $ 4 . 

^0 The synthesizer 1 55 synthesizes the moving image signals outputted from the decoding units 1 50 to 1 53 respec- 

tively corresponding to "a", "b", "c" and "d" of the pixel unit at the timings of the system signals ^ to tf> 4 into one moving 
image signal. The signal outputted from the synthesizer 1 55 is converted by the D/A converter 1 56 into a predetermined 
analog video signal and outputted to the display 123. 

In a case where the number of the partial moving image signals inputted to the decoder 121 is three, the controller 

4 $ 1 20 prohibits read-out operation from the dual port memory 1 46 and controls the connector 1 48 to output pseudo data 
to render the value of k 22 in the equations (7) and (8) "0". For this purpose, the controller 120 controls the dual port 
memory 146 not to perform reading operation and controls the connector 148 to output "0" data. The operations of the 
other components are similar to those in the above case where the number of the partial moving image signals is four. 
In this case, the k 22 value is replaced by "0" in the decoding units 152 and 153 and decoded moving image signals 

50 are outputted. 

If the number of partial moving image signals arrived at the decoder 121 is two, reading operations from the dual 
port memories 145 and 146 are prohibited, and pseudo data is outputted so as to render k^ and k 22 of the equations 
(5) to (8) "0". Accordingly, decoding is performed as k 21 = k 22 = 0 in the decoding units 150 to 153 and decoded signals 
are outputted. 

ss On the other hand, if the number of the partial moving image signals arrived at the decoder 121 is only one, reading 

operations from the dual port memories 144 to 146 are prohibited, and pseudo data is outputted so as to render k^, 
k 21 and k 22 values "0". In the decoding units 1 50 to 1 53, decoding is performed as k, ^ - k 21 = k 22 = 0 and the decoded 
signals are outputted. 
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As described above, according to the present embodiment, coding/decoding of moving image data is performed 
in accordance with transmission load information of moving image data between the terminals connected to the moving 
image network system, and transmission data amount can be adjusted based on the transmission load between the 
terminals which have issued a transmission request, which reduces status of waiting for response to transmission 
5 request and raises responsiveness to transmission request. 

It should be noted that the division of a moving image signal into pixel units is not limited to that shown in Fig. 7. 
For example, division may be made as shown in Fig. 9. 

In this case, only the value of in the equation (1 ) obtained by the division in Fig. 9 is transmitted and the decoder 
121 performs publicly-known processings such as zero-interpolation, low-frequency cut-off processing, resampling for 
10 image reduction to reproduce an excellent 1/2x1/2 sized moving image. If a receiver terminal does not need an original- 
sized moving image output, processing load in relaying by each terminal and waiting status can be reduced. 

Further, in the present embodiment, the encoding units 152 and 153 shown in Fig. 6 are corresponding to high- 
frequency image component. If an input moving image signal does not include much high components, transfer of the 
outputs from the encoding units 152 and 153 to the moving image data transmitter 119 may be omitted, thus reducing 
'5 the processing load upon relaying operation at each terminal and transmission waiting status. 

[Modification] 

Fig. 1 2 is a block diagram showing the configuration of a moving image network system according to a modification 
20 of the third embodiment. The system is constructed for multiplexing moving image data and transmission load infor- 
mation, and transmitting the multiplexed data. In this construction, the components corresponding to those in the moving 
image network system in the third embodiment have the same reference numerals and the explanations of these 
components will be omitted. 

In Fig. 12, reference numeral 157 denotes a transmitter for transmitting moving image data to be transmitted in a 

25 descending order (terminal 101 terminal 105 -> terminal 104 -» terminal 103 -> terminal 102 terminal 101) and 
transmission load information from transmitter 162, i.e., transmission load information regarding moving image data 
transmitted in an ascending order; 158, a receiver for receiving moving image data and transmission load information 
transmitted in the descending order; and 159, a multiplexer for multiplexing the moving image data and transmission 
load information to be transmitted in the descending order. 

30 in Fig. 11, slots 1 to 8 are slots for transmitting the respective moving image data. As described above, in this 

modification, four slots are employed for high-precision transmission of moving image data. Accordingly, using eight 
slots enables high-precision transmission of two moving image data. In Fig. 11, transmission load information is also 
transmitted in a time-divisional manner corresponding to the slots. 

Numeral 1 60 denotes a demultiplexer for demultiplexing the moving image data and transmission load information 

35 received by the receiver 1 58. Numeral 1 62 denotes a transmitter for transmitting moving image data to be transmitted 
in the ascending order (terminal 101 terminal 102 -> terminal 103 -> terminal 104 terminal 105 -» terminal 101) 
and transmission load information from the transmitter 157, i.e., transmission load information regarding the moving 
image data transmitted in the descending order. Numerals 161 , 163 and 164 respectively denote a receiver, a demul- 
tiplexer and a multiplexer, for moving image data and transmission load information transmitted in the ascending order, 

40 having similar functions of the receiver 158, the demultiplexer 160 and the multiplexer 159 for the data transmitted in 
the descending-order. 

In this modification, each terminal selects a transmission order of lower transmission load by examining transmis- 
sion load information of the ascending order and that of the descending order at starting of moving image transmission. 
In case of ascending-order transmission, the transmission terminal receives transmission load information transmitted 
4 $ in the descending order via the demultiplexer 160 and examines the transmission load to control the encoder 122. In 
case of descending-order transmission, the terminal examines the transmission load information via the demultiplexer 
163 to control the encoder 122. 

It should be noted that this modification provides a double-ring topology in which the terminals 101 and 105 are 
connected, however, a double-bus topology in which the terminals 101 and 105 are not connected is also applicable. 

50 

[Fourth Embodiment] 

Fig. 1 3 is a block diagram showing the configuration of a moving image network system according to the fourth 
embodiment of the present invention. In this embodiment, different from the foregoing modification, control is made 
55 based on allowable delay time. In Fig. 13, the moving image network system also comprises five terminals 1101 to 
1105. As these terminals has the same construction, Fig. 13 shows only the construction of the terminal 1101. 

Numerals 1106 to 1110 denote coaxial cables which function as transmission paths connecting the respective 
terminals; 1111 , a receiver for receiving data transmitted on the coaxial cable; 1112, a transmitter for transmitting data 
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onto the coaxial cable. 

Numeral 1113 denotes a storage unit comprising a plurality of FIFO memories for temporarily storing transmission 
data from data from the coaxial cable, in priority order, including data for the terminal 1101 and data to be transmitted 
from the terminal 1101 to the another terminal. Fig. 14 shows the construction of the storage unit 1113. 
s Numeral 1114 denotes a controller for examining a receiver terminal number, priority, a coding type, allowable 

delay time and the like indicated by a header added to the head of a partial moving image packet outputted from the 
receiver 1 1 1 1 . If the receiver terminal number coincides with the number of the terminal 1 1 01 , the controller 1114 inputs 
the partial moving image packet signal outputted from the receiver 1111 into decoder 1115. 

If the receiver terminal number does not coincide with the number of the terminal 1 1 01 , the controller 1114 writes 
10 the data into a predetermined FIFO memory of the storage unit 1113 in accordance with the priority of the data, and 
writes the priority of the partial moving image packet signal and allowable delay time into a management table. Further, 
the controller 1114 searches the management table to read out the partial moving image packets which have been 
stored within the allowable delay time in accordance with priority order and outputs the read data to transmitter 1112. 

The decoder 1115 decodes a single or plurality of partial moving image packet signals which arrived at the terminal 
is and outputs the decoded signals as predetermined analog video signals. As the decoder 1115 has a construction 
similar to that of the decoder 121 in the third embodiment as shown in Fig. 6, the illustration and description of the 
construction of the decoder 1115 will be omitted. 

Numeral 1117 denotes a display which functions as a moving image output device. The display 1117 displays a 
moving image by the analog video signal outputted from the decoder 1115. Numeral 1116 denotes an encoder for 
20 converting the analog video signal outputted from video camera 1118 as a moving image information source into four 
partial moving image data in accordance with the predetermined conversion method shown in the third embodiment, 
adding a predetermined header to the respective data, further, arranging the data as packet data and outputting the 
packet data to the storage unit 1 1 1 3. 

As the encoder 1116 has a construction similar to that of the encoder 122 in the third embodiment as shown in 
25 Fig. 5, the illustration and description of the construction of the encoder 1116 will be omitted. Further, division of moving 
image signal in pixel units is made in a manner similar to that in the third embodiment (Fig. 7) and therefore the illustration 
of the division will be omitted. 

Fig. 14 is a block diagram showing in detail the construction of the storage unit 1113 of the moving image network 
system in the present embodiment. The storage unit 111 3 comprises eight FIFO memories I to VI II. Though Fig. 14 
oo shows only the construction of the FIFO I, each FIFO has dual port memory 1120 for independently performing writing 
and reading out, writing counter 1121 for generating a writing address and read-out counter 1 1 22 for generating a read- 
out address. 

The operation of the moving image network system according to the fourth embodiment of the present invention 
will be described below. The operations of each terminal of the moving image network system are divided into the 
os following three operations, and each terminal performs one of these necessary operations. However, these operations 
are similar to those in the third embodiment, and therefore, operations characteristic to the present embodiment will 
be mainly described. 

In this system, each terminal performs one of the following three necessary operations; 

40 (1 ) coding: dividing a transmission moving image signal into partial moving image signals and encoding the partial 

moving image signals. 

(2) relaying: transmitting partial moving image data signal received from a transmission path and partial moving 
image data generated by the terminal itself onto the transmission path in accordance with a predetermined pro- 
cedure. 

4 $ (3) decoding: decoding received partial to the terminal itself moving image signals. 

<Encoding Operation> 

When a moving image signal is inputted from the video camera 1118 into the encoder 1116, the system clock 
so generator 1 29 of the encoder 1116 separates horizontal and vertical synchronous signals from the moving image signal. 
The sampling timings of the present embodiment are the same as those as shown in Fig. 8 (the sampling signals ^ 
to <J) 4 quadruply interleaved at the period 4T which is a quadruple of the pixel period of an input moving image signal). 
The moving image signal inputted from the video camera 1118 is sampled in the pixel units "a, b, c and d" (Fig. 7) and 
A/D-converted by the A/D converters 125 to 128. Clock <t> 0 latches the A/D converters 125 to 128 so as to simultaneously 
$5 output the converted data to the encoding units 1 31 to 1 34 via the connector 1 30. 

The operation of the encoding units is similar to that of those in the third embodiment and therefore the explanation 
of the operation will be omitted. 

The read-out counter 140 generates a read-out address at a predetermined transmission timing and outputs the 
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address to the dual port memories 1 36 to 1 39. A partial moving image signal is sequentially read out of the dual port 
memory 136 as a serial signal and outputted to the header adder 141. 

The header adder 1 41 adds header information including a receiver terminal address, the address of the terminal 
1101 as a transmitter terminal address, coding type "A", priority "1 ", the transmission time as coding time and allowable 

5 delay time 4ms to the output from the dual port memory 1 36, and writes the data into the FIFO V of the storage unit 
1113. This allowable delay time is a time range that a viewer of the moving image does not feel anxiety upon transmission 
of moving image data. Similarly, the header adder 141 adds header information including the same transmitter and 
receiver terminal addresses, coding type "B" and priority "2", same tansmission time and allowable dalay time to-the 
output from the dual port memory 137 and outputs the data to the FIFO VI of the storage unit 1113. 

10 The header adder 141 adds header information including the same transmitter and receiver terminal addresses, 

coding type "C" and priority "3", the same tansmission time and allowable dalay time to the output from the dual port 
memory 1 38 and outputs the data to the FIFO VI I of the storage unit 1113. Further, the header adder 1 41 adds header 
information including the same transmitter and receiver terminal addresses, coding type "D" and priority "4", the same 
transmission time and allowable delay time to the output from the dual port memory 1 39 and outputs the data to the 

'5 FIFO VIII of the storage unit 1113. 

The data written into the FIFO's Vto VIII are processed in relaying operations to be described below. 

<Relaying Operation> 

20 a partial moving image signal data transmitted from another terminal (e.g., the terminal 1105) to the terminal 1101 

is received by the receiver 111 1 via the transmission path 1110. The controller 1114 examines the header information 
of the data and sets the output destination of the data. If the receiver terminal address coincides with the terminal 1101 , 
the output of the receiver 1111 is transferred to the decoder 1115. However, if the receiver terminal address does not 
coincide with the address of the terminal 1101, the controller 1114 examines the priority information. If the priority is 

25 "1", the data is outputted to the dual port memory 1120 of the FIFO I in the storage unit 1113. 

Similarly, if the priority is "2", the data is outputted to the dual port memory 11 20 of the FIFO II; if the priority is "3", 
the data is outputted to the dual port memory 1120 of the FIFO III; and if the priority is "4", the data is outputted to the 
dual port memory 1120 of the FIFO IV. The partial moving image signal to the storage unit 1113 is sequentially written 
into a predetermined area in accordance with a writing address outputted from the writing counter 1121. At this time, 

30 the controller 1114 registers a writing start address and a writing end address, and the transmission time and the 
allowable delay time added to the header information into the management table. 

In this manner, the partial moving image signal received by the receiver 1111 is written into the FIFO I to IV, and 
as described above, the partial moving image signal to be transmitted from the terminal 1101 is written into the FIFO 
Vto FIFO VIII. 

35 The controller 1114 examines presence/absence of untransmitted partial moving image data in the FIFO's by com- 

paring the reading count value and the writing count value of the respective FIFO's. If there is untransmitted partial 
moving image data, the controller 1114 examines the transmission time and allowable delay time of the data from the 
management table. If a value obtained by adding the transmission time and the allowable delay time reaches over 
current time, the controller regards the transmission data as "valid data", outputs a reading address from the read-out 

40 counter 1 1 22 to read the data out of the dual port memory 1 1 20, and outputs the read data to the transmitter 1112. The 
transmitter 1112 converts the received data to a predetermined digital signal and transmits the signal onto the trans- 
mission path 1106. 

On the other hand, if the value obtained by adding the transmission time and the allowable delay time does not 
reach the current time, the controller 1114 regards the data "invalid" and cuts the data by setting the read-out count 
^5 value to the writing start address of the subsequent partial moving image signal. 

When there is no untransmitted partial moving image data signal in the FIFO I for the highest priority data, the 
controller 1114 transmits untransmitted data stored in the FIFO II in a similar manner to that of the transmission of the 
FIFO I. If a partial moving image signal is newly written into the FIFO I during the transmission of data in the FIFO II, 
the controller 1114 transmits the partial moving image data signal in the FIFO I after the transmission of the data in the 
so FIFO II. 

In this manner, transmission of partial moving image signal is started from higher priority data, and lower priority 
data is transmitted during/after the transmission of the higher priority data. 

<Decoding Operation> 

55 

When the partial moving image data signal is inputted into the decoder 1115, the header remover 142 removes 
the header of the data. If the coding type registered in the header is "A", the signal is written into the dual port memory 
143 for the coding type "A" in accordance with a writing address outputted from the writing counter 147. If the coding 
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type is any of "B", a C u and "D", the signal is written into a corresponding one of the dual port memory 144 for coding 
type "B", the dual port memory 145 for coding type "C" and the dual port memory 146 for coding type H D" in accordance 
with a writing address from the writing counter 147. 

The partial moving image data signal from a transmitter terminal is relayed by the terminal between the transmitter 
and receiver terminals to the receiver terminal. During the transmission, if the transmission load becomes large and 
the transmission delay exceeds the allowable delay time, the transmission comes into a waiting status and the partial 
moving image signal is deleted as described above. For this reason, all the four partial moving image data signals do 
not always arrive at the receiver 1111. That is, the operation of the decoder 1115 changes in accordance with the 
number of the arrived partial moving image signals. 

As the processings by the controller 11 14 based on the number of partial moving image signals are similar to those 
in the third embodiment, the explanation of these processings will be omitted. It should be noted that in this embodiment, 
if the decoder 1115 receives no partial moving image data signal, the decoder 1115 reproduces a moving image signal 
using the partial moving image signal of a previous processing that remains in the dual port memory and outputs the 
reproduced signal. 

As described above, according to the present embodiment, transmitting moving image data signals on the moving 
image network system in accordance with priority order so as to reduce delay time, and removing image data which 
is delayed over the allowable delay time to efficiently use the transmission paths, reduces status of waiting for response 
to transmission request, raises the response and prevents halt of moving image signal. 

Similarly to the third embodiment, the division of a moving image signal in pixel units is not limited to that as shown 
in Fig. 7, and the division as shown in Fig. 9 is applicable. 

Further, similarly to the third embodiment, the encoding units 133 and 134 are corresponding to high-frequency 
image component. In case where an input moving image signal does not include much high-frequency component, 
the outputs from the encoding units 133 and 134 may be stopped to reduce transmission load in relaying processing 
at each terminal and transmission-waiting status. 

In this embodiment, the coding is not limited to the above method. A hierarchical coding scheme, e.g., DCT hier- 
archical coding can be employed. Such hierarchical coding as a modification will be described below. 

[Modification] 

Fig. 15 is a block diagram showing a modification to the construction of the encoder of the moving image network 
system in the fourth embodiment. The encoder of Fig. 15 performs sub-band coding by filter construction. Reference 
numeral 1156 denotes an A/D converter for digitizing a moving image signal outputted from the video camera 1118; 
1 1 57, a horizontal low-pass filter for passing only low-frequency component in a horizontal direction of the video image; 
and 1158, a horizontal high-pass filter for passing only high-frequency component in the horizontal direction of the 
video image. 

Numeral 1 1 59 denotes a system clock generator for extracting a synchronous signal from the moving image signal 
outputted from the video camera 1118 and generating sampling signals and various timing signals used within the 
terminal; 1160 and 1161 , decimeters for thinning the number of pixels in the horizontal direction by half. 

Numerals 1162 and 1164 denote vertical low-pass filters for passing only low-frequency component in a vertical 
direction of the video image; and 1163 and 1165, vertical high-pass filters for passing only high-frequency component 
in the vertical direction of the video image. 

Numerals 1166 to 1169 denote decimeters for thinning the number of pixels in a vertical direction by half; 1170 to 
1 1 73, quantizers for compressing the outputs from the decimeters 1 1 66 to 1 1 69 to a predetermined bit length; 1 1 74 to 
1177, dual port memories; 1178, a header adder; 1179, a writing counter; and 1180, a read-out counter. Note that the 
dual port memories and the counters respectively correspond to the dual port memories and the counters in the third 
embodiment (Fig. 5). 

In this modification, when the moving image signal from the video camera 1118 enters the encoder, a sampling 
signal having the same period as the pixel period T is generated. More specifically, the A/D converter 1 1 56 A/D-converts 
the moving image signal by the sampling clock outputted from the system clock generator 1159 and outputs the con- 
verted signal to the horizontal low-pass filter 1157 and the horizontal high-pass filter 1158. 

The horizontal low-pass filter 1157 removes high-frequency component in the horizontal direction of the signal. 
The decimeter 1160 thins the number of pixels by half in the horizontal direction. 

The vertical low-pass filter 1162 removes high-frequency component of the output from the decimeter 1160. The 
decimeter 1 1 66 thins the number of pixels by half in the vertical direction. Thereafter, the quantizer 1 1 70 compresses 
the data to a predetermined bit length. The quantizer 1170 outputs a partial moving image signal which includes only 
low-frequency component in both the horizontal and vertical directions to the dual port memory 11 74. 

The output from the decimeter 1160 is also provided to the vertical high-pass filter 1163 which removes low-fre- 
quency component in the vertical direction. The decimeter 1 167 thins the number of pixels by half in the vertical direction, 
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and the quantizer 1171 compresses the data to a predetermined bit length. The quantizer 1171 outputs a partial moving 
image signal which includes low-frequency component in the horizontal direction and high-frequency component in 
the vertical direction to the dual port memory 1175. 

The moving image signal including high-frequency component in the horizontal direction outputted from the dec- 

5 imeter 1161 enters the vertical low-pass filter 1164 which removes high-frequency component in the vertical direction. 
The decimeter 1168 thins the number of pixels by half in the vertical direction. The quantizer 1172 compresses the 
data into a predetermined bit length, and outputs a partial moving image signal including high-frequency component 
in the horizontal direction and low-frequency component in the vertical direction to the dual port memory 1176. 

The output from the decimeter 1161 is also provided to the vertical high-pass filter 1165 which removes low-fre- 

w quency component in the vertical direction. The decimeter 1 1 69 thins the number of pixels by half in the vertical direction, 
and the quantizer 1 1 73 compresses the data to a predetermined bit length. The quantizer 1 1 73 outputs a partial moving 
image signal including only high-frequency component in both the horizontal and vertical directions to the dual port 
memory 1177. 

The four partial moving image signals outputted to the dual port memories 1174 to 1177 are respectively read out 
>5 from the dual port memories. The header adder 1178 adds a header to the respective signals and outputs the data to 
the storage unit 1113. 

Fig. 16 is a block diagram showing the construction of the decoder of this modification. In Fig. 16, reference numeral 
11 79 denotes a header remover; 11 80 to 1183, dual port memories; 1184, a writing counter; 1189, a read-out counter; 
and 1194, a system clock generator. Note that the dual port memories, counters and the system clock generator have 

20 the same functions as those of the encoder in the third embodiment (Fig. 16). 

Numeral 1185 to 1888 denote inverse quantizers for expanding the bit length data compressed by the quantizers 
of the encoder to a predetermined length data; 1190 to 1193, interpolators for interpolating the pixels to a doubled 
number; 1195 and 1197, vertical low-pass filters for passing only low-frequency component in the vertical direction; 
and 1196 and 1198, vertical high-pas filters for passing only high-frequency component in the vertical direction. 

25 Numerals 1199 and 11101 denote interpolators for interpolating the number of pixels to a doubled number in the 

horizontal direction; 11 100,. a horizontal low-pass filters for passing only low-frequency component in the horizontal 
direction; 11102, a horizontal high-pass filter for passing only high-frequency component in the horizontal direction; 
11103, a signal synthesizer; and 11104, a D/A converter. 

The partial moving image data signals arrived at the decoder 1115 are written into the dual port memories 1180 

30 to 1 1 83 respectively in accordance with a coding type registered in the header, and sequentially outputted in accordance 
with a read-out address outputted from the read-out counter 1189. If the number of partial moving image data signals 
arrived at the decoder 1115 is four, all the outputs from the dual port memories 1180 to 11 83 are used for decoding. 

The output from the dual port memory 1180 is a partial moving image signal including only low-frequency compo- 
nent in both the horizontal and vertical directions. The inverse quantizer 1185 expands the signal into a predetermined 

35 bit length and the interpolator 1 1 90 interpolates the pixels to a doubled number. The vertical low-pass filter 1 1 95 removes 
high-frequency noise component occurred in the interpolation and outputs the data to the interpolator 1199. 

The output from the dual port memory 1181 is a partial moving image signal including low-frequency component 
in the horizontal direction and high-frequency component in the vertical direction. The inverse quantizer 1186 expands 
the signal to a predetermined bit length and the interpolator 1191 interpolates the pixels to a doubled number in the 

to vertical direction. The vertical high-pass filter 1196 removes low-frequency noise component occurred in the interpo- 
lation and outputs the data to the interpolator 1199. 

The interpolator 1199 interpolates the pixels to a doubled number in the horizontal direction, and the horizontal 
low-pass filter 11100 removes low-frequency noise component in the horizontal direction occurred in the interpolation 
and outputs the data to the synthesizer 1 1 1 03. 

45 The output from the dual port memory 1182 is a partial image signal including high-frequency component in the 

horizontal direction and low-frequency component in the vertical direction. The inverse quantizer 1187 expands the 
signal to a predetermined bit length, and the interpolator 1 1 92 interpolates the pixels to a doubled number in the vertical 
direction. The vertical low-pass filter 1197 removes high-frequency noise component in the vertical direction occurred 
in the interpolation and outputs the data to the interpolator 11101. 

50 The output from the dual port memory 1183 is a partial moving image signal including only high-frequency com- 

ponent in both the horizontal and vertical directions. The interpolator 1193 interpolates the pixels to a doubled number 
in the vertical direction. The vertical high-pass filter 1198 removes low-frequency noise component occurred in the 
interpolation and outputs the data to the interpolator 11101. 

The interpolator 11101 interpolates the pixels to a doubled number in the horizontal direction, and the horizontal 

55 high-pass filter 11102 removes low-frequency component noise in the horizontal direction and outputs the data to the 
synthesizer 11103. The synthesizer 11 103 combines the signal which lacks high-frequency component in the horizontal 
direction outputted from the horizontal low-pass filter 11100 and the signal which lacks low-frequency component in 
the horizontal direction outputted from the horizontal high-pass filter 11102 to reproduce the original moving image 
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signal and outputs the signal to the D/A converter 11104. The D/A converter 11104 converts the moving image signal 
to a predetermined analog video signal and outputs the signal to the display 11 17. 

If the number of the partial moving image data signals arrived at the decoder 11 1 5 is less than four, similarly to the 
third embodiment, the dual port memory corresponding to the non -arrived partial moving image signal outputs a pseudo 
signal having a value "0" for decoding. 

As described above, according to the modification, control of the relaying or deletion of moving image data based 
on priority order in accordance with transmission load of moving image data enables transmission band assignment 
corresponding to the transmission load of the transmission path of the terminal that has issued a moving image data 
transmission request, which reduces status of waiting for response to transmission request and raises the response. 

Further, coding/decoding moving image data based on priority of the moving image data and its allowable trans- 
mission delay time raises usage efficiency of transmission paths, reduces status of waiting for a response to transmis- 
sion request and improves the response. 

The present invention can be applied to a system constituted by a plurality of devices, or to an apparatus comprising 
a simple device. Furthermore, it goes without saying that the invention is applicable also to a case where the object of 
the invention is attained by supplying a program to a system or apparatus. 

According to one aspect of the present invention provides: 

an information network system comprising: 
a plurality of terminals; and 

a plurality of transmission media forming a transmission path among the plurality of terminals, each of transmission 
media connecting two of said plurality of terminals, and said plurality of terminals, 

wherein each of the plurality of terminals includes: 

a memory for relaying transmitted information; and 

transmission means for transmitting the transmitted information in accordance with priority order 

The transmission means can transmit the transmitted information in a predetermined direction on the transmission 
path formed with the transmission media. 

Preferably, the information is moving image information. 

According to another aspect of the present invention provides a terminal apparatus comprising; 

reception means for receiving transmitted information; 
generation means for generating transmission information; 

memory means for storing at least a part of the transmitted information received by said reception means and the 
transmission information generated by said generation means; and 

transmission means for transmitting the information stored in said memory means in accordance with a given 
priority order. 

The memory means can include: 

a plurality of memories in a predetermined order; and 

control means for storing the information received by said reception means into one of the plurality of memories 
in the predetermined order in accordance with priority information included in the information, and storing the 
transmission information generated by said generation means, into one of the plurality of memories in the prede- 
termined order in accordance with priority information included in the transmission information. 

The transmission means can perform transmission from data stored in one of the plurality of memories having the 
highest priority. 

Another aspect of the present invention provides an information network system comprising a plurality of terminals, 
and a plurality of transmission media forming a transmission path by connecting the plurality of terminals; characterised 
in that the plurality of terminals respectively have a memory for relaying transmission information, and transmission 
means for transmitting the transmission information in accordance with priority order; wherein said system transmits 
the transmission information on the transmission path formed by the transmission media in a predetermined direction. 
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Claims 

1. A moving image network system, in which a plurality of terminals are connected to each other via a transmission 
path, for inserting moving image data into a plurality of channels and transmitting/receiving the moving image data, 
comprising: 

means for generating transmission load information regarding transmission of the moving image data on the 
transmission path; 

means for transmitting/receiving the transmission load information; 

coding means for encoding the moving image data based on a predetermined coding method in accordance 
with the transmission load information; and 

decoding means for decoding the moving image data based on a predetermined decoding method. 

2. The system according to claim 1 , wherein said transmission load information includes at least one of information 
specifying a transmitter terminal of the moving image data, information specifying a receiver terminal of the moving 
image data, transmission priority of the moving image data and a coding type. 

3. The system according to claim 1 or claim 2, wherein said coding means is adapted to change coding operation in 
accordance with a number of channels which the moving image data is to be inserted. 

4. The system according to any one of claims 1 to 3, wherein if there is no empty channel, said coding means is 
adapted to delete moving image data having priority lower than a predetermined priority and inserts the moving 
image data having priority higher than that of the deleted data into a channel for the deleted data. 

5. The system according to any preceding claim, wherein said decoding means is adapted to change decoding op- 
eration in accordance with the coding type. 

6. The system according to any preceding claim, wherein said coding means is adapted to continue to divide the 
moving image data as a pixel unit having N (N is an integer) pixels into two pixel groups until a number of pixels 
belonging to each pixel group becomes one, and to encode the moving image data using N coding conversion 
values obtained from 2N-1 average values with respect to each pixel group image signal. 

7. A moving image terminal connectable to another terminal via a transmission path, for transmitting/receiving moving 
image data between the terminals, comprising: 

storage means for storing the moving image data, 

means for generating management information for the moving image data; and 

coding means for encoding the moving image data based on a predetermined coding method in accordance 
with the management information. 

8. The terminal according to claim 7, further comprising decoding means for decoding the moving image data based 
on a predetermined decoding conversion method in accordance with the management information. 

9. The terminal according to claim 7 or claim 8, wherein the management information includes at least information 
specifying a transmitter terminal of the moving image data, information specifying a receiver terminal of the moving 
image data, transmission priority of the moving image data, a coding type, a writing start address and writing end 
address for writing of the moving image data into said storage means, transmission time of the moving image data 
and allowable delay time of the moving image data. 

10. The terminal according to claim 9, wherein said storage means is adapted to store the moving image data into a 
predetermined area in accordance with the transmission priority of the moving image data, and said storage means 
has data judgement means for judging, if there is untransmitted moving image data in the area, validity of the 
untransmitted moving image data based on the transmission time of the moving image data and the allowable 
delay time of the moving image data. 

11. The terminal according to claim 10, wherein, if judgement time obtained by adding the transmission time of the 
moving image data and the allowable delay time of the moving image data reaches over current time, said data 
judgement means is adapted to judge that the untransmitted moving image data is valid, while judging that the 
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u retransmitted moving image data is invalid, and to delete the untransmitted moving image data if the judgement 
time does not reach the current time. 

12. The terminal according to claim 11 , wherein said coding means is adapted to continue to divide the moving image 
data as a pixel unit having N (N is an integer) pixels into two pixel groups until a number of pixels belonging to 
each pixel group becomes one, and to encode the moving image data using N coding conversion values obtained 
from 2N-1 average values with respect to each pixel group image signal. 

13. An information transmitting apparatus comprising: 

first means for generating a moving image information to be transmitted; 

second means for generating another information that is no in regard to the moving image information; and 
means for transmitting the moving image information through network prior to said another information. 

15 14. An information transmitting apparatus according to claim 13, wherein said moving image information is compressed 
by hierarchical compression method. 

1 5. An information transmitting apparatus according to claim 1 3, wherein said transmitting means is adapted to transmit 
lower resolution information of said moving image information prior to higher resolution information of said moving 

20 image information. 

16. A moving image network system in which upon transmitting moving image data from a first terminal to a second 
terminal, a controller (20) adds a transmitter terminal address, priority and a coding type of the moving image data 
to transmission load information received by transmission load information receiver (17), and outputs the data to 

2S transmission load information transmitter (16), said controller (20) effecting encoding/decoding of the moving image 

data in accordance with the transmission load information of the moving image data and adjusts the transmission 
data amount corresponding to the transmission load of a transmission path. 
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